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(57) Abrege/Abstract: 

A peer-vector machsne includes a host processor and a hardwired pEpelme acc^erator. The host processor executes a program, 
and, In response to the program, generates host data, and the pipeline accelerator generates ptpetjne data from the host data. 
AitemativeJy, the pipelme accelerator generates the pipeline data, and the host processor generates the host data ffom the pipeline 
data. Because the peer-vector machine indudes both a processor and a ptpeiine acceierator, it can often process data more 
effj'dently than a machine that rricludes only processofs or only acceleralors. For exampie, one can desigri the peer'VectOf fnachine 
so that the host processor performs decisfon-makmg and non-mathematicalty intensive operattons and the accelerator performs 
non-decfsiDn-makjng and mathematically intensive opera^ons. By shifting the mathematEcally intensive operations to the 
accalerator, the pear-vaotor machine often can, for a given clock frequency, process data at a speed that surpasses the speed at 
which a processor-onJy machine can process the data. 

fl*l 

ornc 



SlXl.O.dO' J^///?.yvb/wb.^'£r.t^'? • Ottawa-Hull K] A 0C9 * Jbttp:M:^.gc,c^ 




OK 02503611 2005-04-25 



f 12) IN lERNATiONAL APPI JCATiON PUBi JSHED UNOER Vim mi ENT C€K>PKRATI(>N TMHAI'Y (PCT> 



(19) World inivlk'etus^ Properly 
Or|>aiiiiK£ittt>H 

IntematJOt^fil Bureau 




IlillllPllllilillllliliiliililillillll 



(43) ItiteraatJoBal PubiicatioB Date (50) latt'rfiayonial PuhJScalioa Namher 

21 May 2004(21.05.2004) PCX WO 2004/042560 A3 

(51) iiitaiaJioiial FiEilisttI CiaMificatlon^: G06F 9/38. 15/78 (71) Appii«iii£ {for nil de^ngmml Snues excepi USh IX>€E- 

BEEil MARTIN CORPORATION lUSAJS}; BuiMmg 
ai) l«teraati«aal Ap|>lkatl«» Ntwsiber^ '^^^^ ^^^<'P ^^^^ "^^^^^ ai>dwin Dtivi^, M^imssiis, VA 

(72) i«v€Sfitors; tmd 

my Interaadojial Fliiwg I>«t4!: M October 20(B (3U IfUOfB) (7$) Im^^titors^Ajtpilainis (for US only}t MATHiJR, Cfeati- 

dUim fUS/USh 11162 IMvate^.*^ Coi-trS. Mariasiitts. VA 

(25) FiJitigl^tigtiB^; English ^»^09 (13^). HELLENBACH, Scott iUSA3S|; 153$} 

Quail Riogc: DriYC, Am<;s^vjtk, VA 20106 (irS). RAin\ 
. . .1. ,r . John, W. rn>;/liSl: 9350 Rvver Cms.! Ro^d. M^musjiasi. 

a6> PubJic^tmnLangimj^e: hf.gh.fi 2^>|]0 (US) JACKi^ON. Larry iUS/USJ: O093 

Cresa>«x>k Dnve,, Mimas^as, m 2oi 12 (US). JONES, 

(3m Prkmty l>ata: Mark [US/USj: 15342 ()akr»fim Place, C::fiiiS:mvi[je, VA 

mi4^^m 31 <)ct(te 2002 (3L1 0.20(E) l^S -joi^O {Xm, CnmAS^mX rny^ f US;US1; 1524 Ke^tral 

10/683.929 9 October 2(HB (09.10.2{>03 ) US Ojutt. Cuipcrper: VA 22701 (US).^ 

10.^6^:^.932 9 Oclober 3(X>3 (09.10,20^3) US 

1 0^^84.053 9 October 2im (09, i0.2f>03 J ITS ^m^^ S ANmRElJ J , Brysiii, A. ei fii : Grviy beal Jack^ 

J(>^H4,057 9 October 20(B mHOOCB) l^S IMcy LLE !55^108th Avenue KB, SuiteBSa Bdleviae, 

10/f384a02 9 October 2{K)3 (09,10.21)03) US ^'^^ '^^^^^^ ^^^>^ 

(m mmgmivd St«to (namnal}: AIL AC?, AL, AM, Ai; AU, 
^^S3) R^^lat^ ii^ cotitlmiatiOii (CO^i) or eontiatiatlon-lit-jpart AZ, B A, BB. SG, BR, HW, BY; BZ. CA, CH, CH, C(X CR, 

(CIF) to earSier «ippiicati«Mi: CU, CZ, Dfi, OK. DM, DZ, liC, JiB, liS, 1% OB, CiD, Ofi, 

US 60A122,503 (CIP) GH, GM, HR, HU, ID. IL, iM= IS, KB, KG, KR, 

HJed on 31 Ocloto-2tm(3L10,2«J02.) KZ, LC, LK, LR. LS, IX Ul m MA. MIX MG, MK, 

(54> I'lttei PIPKTJNE CX)PECK:T?SS0R 



^ ........... ; 1 ^ , ;j ' { x,.^ ; ( Ni3k»uvuywt: f 

«» r ; If 11 I \ Ik' 



^ ^ 1 ^ 



< 



1 WEPi-KSTv' ; 



gas / ^ .!l5?5y?i^i^-r^ I ^ 1 1 ^ — " 

est 

(57) Absimct: A peer- vector macsnne inc.Iudiss a hoist prcjcessor and a. hardwired pipe tine accelerator., rhe host prtjcessor executes 
a fJrograriT, and, in .re^fipiijnso to the pojgnim> gcnenjies hCiHi data, aad Lhe pipeline actieJcjj'atJijr genei'Mcs pij>e;line datii from the iiost 
iiats.., AlieiTti«hely. the pi3>eltne 4icceJer<iior generates ilie pit>eline d<uii, and iJie host pmcessor generates liie host data from the 
pi|>2it:ji5 daSa. Because the {^i^r-vector c«iicMne includes both a pjx>ct*ssc>t and » pifjeluie acceietator, it fan Oi'ten pjx^icejss diiiamtjre 
CD *5i:fic3ejii5y ihaii & firachij5e tljat includes only pjX3ce.ss<H's ox ottly accefei-atiiii-s, Ikft example, one can cbsigrj tlie p<jer- veeior machine 
so tfiiJt the host proce&sor fjsribrms decision-JBakhig md mm-mathmy»itim\ly mi&mxva openitk^rss arid tfte; ijcceJeraior fxsribnns mm- 
^•s decision- mjiking ijnd m;jJhem3ti«;^4Jly intensive opeimiofij^. By shifting the mathi^matkiilly kitetist v*? opemdons 10 the; si«x'eJerafe.*i\ the 
>^ peer -\^lor machine often can, lor given clock fre(jijenc-y» process data ai a iipeeti UiaJ surpa&stjfi ihe )>j>eed ai wJiich a pr^seest&or-tmiy 
niacttine can pR^cess the data. 



OK 02503611 2005-04-25 



WO 2004/042560 A3 iiilliilliliilliilllililiiiiililiiiilll 



MN. m\\ ^4X, MZ, Nf, NO, HZ, OJVI, IKh PH, PL, Fi; Pabiliili*?d? 

RO, RU, ^iC, SD, S tL SC>, SK, SL, SY, IM, TM, TNy Ui, ■ — with mf^matkmai search mpt^rt 

Ti; Tz, UA, UG, i;s, uz. v<; vn, yu, za, zm, zw. 



(84) Di^igiiated Stjito ^ms*imial>i ARIK) p<«l^snt fBW. GH, 
GM, iCE, MVv^ MZ, SD, SL, SZ, TZ, UG, ZM, 2M\ 
i^urasfan patent (AM, AZ, BX KO, KZ, MD, RU, l\K VM), 
Eurap^m pincni (KL BE, CM, CY, CZ mi OK, liE, 
BS, H/FR, GB, GR, HIJ; iB. ri. UT, MC. NL, Fi; R<>, SB, 
SL SK, TE). OAPi patent (BR BJ. CE CO. CI CM, OA. 
CiM; GQ. tm ML, MR, NB, SN, m TC). 



(88) llate of pttblicatibn of the ititcrtiatlofiial st^jtjx^h r<^f>rtj 

24 Mimii 2005 

/•i>/^' livo-ieU^ code.^- ami oiher almm'mikfns. r^fer if} the "Gukl- 
ameNmm <m Codes mdAbbrei'iatiom^ iiffpemin^ at the bei^in- 
nittg of each regular issue of the FCT Cazi?it^. 



wo 20(M/<M2560 



CA 02503611 2005-04-25 



IMPROVED COMPUTING ARCHITECTURE AND RELATED SYSTEM AND 

METHOD 

CLAm OF PRtORItY 

[1] This application claims priority to U,S. Provisional Appiication Serial 

No. 60/422,503, filed on October 31 , 2002, v/Jiich is incorporated by reference. 

Cross R^FgRHNCE to related applications 

[2J This appiication is related to U.S. Patent App, Serial Nos, 10/684,053 

entitted COMPUTING MACHINE HAViNG iMPROVED COMPUTiNG 
ARCHITECTURE AND RELATED SYSTEy AND yETHOD; 10/683,929 entitled 
PiPELiNE ACCELERATOR FOR IMPROVED COMPUTfNG ARCHITECTURE AND 
RELATED SYSTEM AND METHOD; 10/684,057 entitted PROGRAMMABLE 
CiRCUiT AND RELATED COMPUTiNG iVIACHlNE AND METHOD; and 10/683,932 
entitied PIPELINE ACCELERATOR HAViNG MULTIPLE PIPELINE UNITS AND 
RELATED COMPUTING MACHINE AND METHOD: all filed on Octobers, 2003, 
and having a common owner, and which are incorporated by reference, 

BACKGROUND 

|33 A common computing architecture for processing relatfvely large 

amounts of data in a relatively short period of time includes muitipSe interconnected 
processors that share the processing burden. By sharing the processing burden, 
these multiple processors can often process the data more quickly than a single 
processor can for a given clock frequency. For example, each of the processors can 
process a respective portion of the data or execute a respective portion of a 
processing algorithm* 

£4] FIG. 1 is a schematic block diagram of a conventional computing 

machine 10 having a multj-processor architecture. The machine 10 includes a 
master processor f 2 and coprocessors 14i - f4„, which communicate with each 
other and the master processor via a bus 16, an input port 13 for receiving raw data 
from a remote device (not shown in FIG. 1), and an output port 20 for providing 
processed data to the remote source. The machine 10 also Includes a memory 22 
for the master processor 12, respective memories 24i - 24f, for the coprocessors 14i 
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- 14n, and a memory 26 that the master processor and coprocessors share via the 
bus 16, The memory 22 serves as both a program and a workSng memory for the 
master processor 12, and each memory 24i - 24n serves as both a program and a 
working memory for a respective coprocessor 14^ - 14^. The shared memory 26 
allows the master processor t2aod the coprocessors 14 to transfer data among 
thamseives, and from/to the remote device via the ports 18 and 20, respeotively, 
The master processor 12 and the coprocessors 14 aiso receive a common clock 
signal that controis the speed at which the machine 10 processes the raw data. 

[5] In generaf , the computing machine 10 effectively divides the 

processing of raw data among the master processor 12 and the coprocessors 14. 
The remote source (not shown in FIG. 1 ) such as a sonar array (FIG. 5) loads the 
raw data via the port 18 into a section of the shared memory 26, which acts as a 
first-in-first-out (FIFO) buffer (not shown) for the raw data. The master processor 12 
retrieves the raw data from the memory 26 via the bus 16, and then the master 
processor and the coprocessors 14 process the raw data, transferring data among 
themselves as necessary via the bus 16. The master processor 12 loads the 
processod data into another FIFO buffer (not shown) defined in the shared memory 
26, and the remote source retneves the processed data from this FIFO via the port 
20. 

[6| in an example of operation, the computing machine 10 processes the 

raw data by sequentlaiiy perfomiing n ^ 1 respective operations on the raw data, 
where these operations together compose a processing aSgorithm such as a Fast 
Fourier Transfoim (FFT)- More specifically, the machine 10 fonms a data-processing 
pipeline from the master processor 12 and the copmcessors 14. For a given 
frequency of the dodk signal, such a pipeline often allows the machine 10 to process 
the raw data faster than a machine having only a singie processor 

£71 After retrieving the raw data from the raw-data FIFO (not shown) m the 

memory 26, the master processor 12 performs a first operation, such as a 
trigonometric function, on the raw dBiB. This operation yields a first result, which the 
processor 12 stores in a first-result FiFO (not shown) defined within the memory 26. 
Typically, the processor 12 executes a program stored in the memory 22, and 
performs the above*described actions under the control of the program. The 
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processor 12 may also use the memory 22 as worthing memory to temporarily store 
data that the processor generates at intermediate intervals of the first operation. 

C8] Next, after retrieving the first result from the first^resutt FIFO {not 

shown) in the memory 26, the coprocessor 14i perfomis a second operation, such 
as a logarithmic function, on ttie first resuii This second operation yields a second 
result which the coprocessor 14i stores in a second-result FIFO (not shown) defined 
wfthin the memory 2S. Typically, the coprocessor 14i executes a program stored in 
the memory 24^ and performs the above-described actions under the control of the 
program. The coprocessor 14i may also use the memory 24i as working memory to 
temporarily store data that the coprocessor generates at i ntermediate intervals of the 
second operation. 

IB} Then, tie coprocessors 24^ - 24^ sequentiaiiy perform third - n^^ 

operations on the second - (n-l)*^ results in a manner similar to that discussed 
above for the coprooessor 24 f. 

[10] The n^ operation, which Is performed by the coprocessor 24n, yields 

the final result, /,e., the processed data. The coprocessor 24« loads the processed 
data into a processed-data FIFO (not shown) defined within the memory 26, and the 
remote device (not shown in FIG. 1) retrieves the processed data from this FIFO. 

[11] Because the master processor 12 and coprocessors 14 are 

simuftaneousiy performing different operations of the processing a!gorithm, the 
computing machine 10 is often abte to process the raw data faster than a computing 
machine having a single processor that sequentiaily performs the different 
operations. Specifically, the single processor cannot retrieve a new set of the raw 
data until it performs ail n operations on the previous set of raw data. But using 
the pipeline technique discussed above, the master processor 12 can retrieve a new 
set of raw data after perfonning only the first operation. Consequentty, for a given 
dock frequency, this pipeline technique can increase the speed at which the 
machine 10 processes the raw data by a factor of approximately n + 1 as compared 
to a single-processor machine (not shown in FIG* 1). 

[12J Aiternatively, the computing machine W may process the raw data in 

paralfef by simyitaneously performing n ^ 1 instances of a processing algorithm, 
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such as an FFT, on the raw data. That is, if the algorithm tncludes n ^ 1 sequentiaJ 
operations as described above in the previous example, than each of the master 
processor 12 and the coprocessors 14 sequentially perform all n -^^ 1 operations on 
respective sets of the raw data. Consequently, for a given ciook frequency, this 
paraliel-processing technique, like the above-described pipeline technique, can 
increase the speed at which the machine 10 processes the raw data by a factor of 
approximateiy n ^ 1 as compared to a singie*processor machine (not shown in FIG. 

[131 Unfortunateiy, although the computing machine 10 can process data 

more quickly than a single-processor computer machine (not shovi/n in FIG. 1), the 
data-processing speed of the machine 10 is often significantly less than the 
frequency of the processor clock. Specifically, the data-processing speed of the 
ODmputing machine 10 is iimited by the time that the master processor 12 and 
coprocessors 14 require to process data. For brevity, an example of this speed 
limitation is discussed in conjunction with the master processor 12, aithough it is 
understood that this discussion also applies to the coprocessors 14. As discussed 
above, the master pr-ocessor 12 executes a program that controls the processor to 
manipulate data in a desired manner. This program includes a sequence of 
instructions that the processor 12 executes. Unfortunately, the processor 12 
typicafiy requires muitlple clock cycles to execute a single instruction, and crftan must 
execute multiple Instructions to process a single value of data. For example, 
suppose that the processor 12 is to multiply a first date value A (not shown) by a 
second data value B (not shown). During a first clock cycle, the processor 12 
retrieves a multiply instruction from the memory 22. During second and third dock 
cycles, the processor 12 respecSiveiy retrieves A and B from the memory 26. During 
a fourth cfock cycle, t^e processor 12 multiplies A and B, and, during a fifth dock 
cyde> stores the resulting product in the memory 22 or 26 or provides the resulting 
product to the remote device (not showi). This is a best-case scenario, because in 
many cases the processor 12 requires additional clock cycles for overttaad tasks 
such as Initializing and dosing counters. Therefore, at best the processor ^2 
requires five clock cycles, or an average of 2>5 clock cycles per data value, to 
process A and B.. 



4 



wo 20(M/<M2560 



CA 02503611 2005-04-25 



[141 Consequentiy, the speed at which the computing maclijne 10 

processes data Is often signiflcantiy iower than the frequenoy of the cfock that drives 
the master processor ^2 and the coprocessors 14. For example, if the processor 12 
is docked at 1,0 Gigahertz (GHz) but requires an average of 2.5 clock cycies per 
data value, than the effective data-processing speed equals (1,0 GHz)/2.5 = 0,4 
GHz. This effective data-processing speed Is often characterized in units of 
operations per second. Therefore, m this exampie, for a clock speed of 1 .0 GHz, the 
processor 12 woufd be rated mth a data-procassing speed of 0.4 
Gigaoperations/seconid (Gops). 

[153 2 is a block diagram of a hardv^/ired data pipeline 30 that can 

typically process data faster than a processor can for a given clock frequency, and 
often at substantrally the same rate at v^fhicli the pipeline is clocked. The plpeiine 30 

inciudes operator circuits 32f - 32^ that each perform a respective operation on 
respective data without execyting program instructions. That is, the desired 
operation is "burned in" to a circuit 32 such that it impSements the operation 
automaticaliy, v^ithout the need of program instructions. By eliminating the overhead 
associated with executing program instructions, the pipeline 30 can typically perform 
more operations per second than a processor can for a given clock frequency, 

[16j For example, the pipeline 30 can often solve the following equation 

faster than a processor can for a given clock frequency: 

where Xk represents a sequence of raw data values. In this example, the operator 
circuit 32i Is a multiplier that calculates 5xk, the circuit 32^ Is an adder that calculates 
6Xk + 3, and the circuit 32n (n 3) is a multiplier that cafcuiates (5Xk S)2^^\ 

{1 7| During a fimt clock cycle k==1 , the circuit 32^ receives data value Xi and 

muftipHes it by 6 to generate 5xi. 

[18] During a second dock cycie k - 2, the circuit 32^ receives 5xi from the 

circuit 32i and adds 3 to generate 5xt + 3. Also, during the second ciook cycle* the 
circuit 32i generates 6x2. 

^^^^ |19] During a Uiird dock cycle k 3, the circuit 32$ receives 5xi + 3 

from the circuit 322 and muitiplies by 2''Heffectivefy right shifts 5xi ^ 3 by xi) to 
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generate the first result (5xi 3)2'^\ Also doring the third ctock cycfe, the circuit 32i 
generates 6x3 and the circuit 322 generates Qkz ^ 3. 

J20] The pipeline 30 continues processing subsequent raw data values m 

this manner until a\l the raw data values are processed. 

[21] Consequently, a delay of two ciock cycles after receiving a raw data 

value Xi — this delay is often called the latency of the pipaline 30 — the pipeline 
generates the resuit (5xi ^ 3)2^\ and thereater generates one result each dock 
cycle. 

[22| Disregarding the latency, the pipeiine 30 thus has a data-processing 

Speed equal to the clock speed. In comparison, assuming that the master processor 
12 and coprocessors 14 {FIG* 1) have data-processing speeds that are OA times the 
ciock speed as in the above example, the pipeline 30 can process data 2,5 times 
faster than the computing machine 10 (FIG. 1) for a given clock speed. 

123] Still referring to FIG. 2. a designer may choose to implement the 

pipeline 30 in a programmable logic IC (PUC), such as a field-programmable gate 
array {FPGA). because a PLtC atfows more design and modification flexibility than 
does an appycation specific IC (ASIC). To configure the hardwired connections 
within a PLIC, the designer merely sets interconnection-configu ration registers 
disposed within the PUC to predetermined binary states. The combination of all 
these binary states is often caiied "firmware/' Typlcaliy, the designer loads this 
firmware into a nonvolatite memory (not shown in FIG. 2) that is coupled to the PLIC. 
When one "turns on^^ the PLIC, it downloads the firmware from the memory into the 
interconnection-configuration registers* Therefore, to modify the ftjnctioning of the 
PLIC, the designer merely modifies the firmware and allows the PLIC to download 
the modified firmware into the interconnection-configuration registers. This ability to 
modify the PUC by merely modifying the firmware is particularly useful during the 
prcjtotyping stage and for upgrading the pipeline 30 In the field". 

124} Unfortunately, the hardwired pipeline 30 typically cannot execute ail 

algorithms, particularJy those that entail significant decision making. A processor can 
typically execyte a decision-making instruction {e.g., conditional instructions such as 
If A, then go to B, else go to C") approximately as fast as it can execute an 
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operational instruction (e.g., "A B") of comparable fength. But although the pSpeHoe 
30 may be able to make a reiativeiy simple decision {e,g,, '"A > B?''), it typlcaHy 
cannot execute a relatively compiex decision {e.g., *1f A, then go to B, else go to C*'y 
And althDugh one may be able to design the plpe!ine 30 to execyte such a complex 
deoision, the size and complexity of the required drcuitry often makes such a design 
impractica!, particutarly where an algorithm includes multipte different complex 
decisions. 

[25] Consequently, processors are typlcaliy used m applications that require 

significant decision making, and hardwired pipelines are typical iy fimfted to ""number 
crunching" applications that entail ftttle or no decision making* 

[26] Furthemiore, as discussed befow, it is typicaiiy much easier for one to 

desfgn/modify a processor-based computing machine, such as the computing 
machine 10 of FIG. 1, than It is to design/modify a hardwired pipeiine such as the 
pipaiine 30 of FIG, 2, particularly where the pipeline 30 includes muitiple PLlCs- 

[273 Computing components, such as processors and their peripherals 

(e.g,, memory), typically include industry-standard communication Interfaces that 
facilitate the interconnection of the components to form a processor-based 
computing machine, 

[28] Typicaily, a standard communicatbn interface incfudas two layers: a 

physical layer and an service layer. 

[29| The physical layer includes the circuitry and the corresponding circuit 

interconnections that form the interface and the operating parameters of this 
circuitry. For example, the physicai layer includes the pins that connect the 
component to a bus, the buffers that latch data received from the pins, and the 
drivers that drive data onto the pins. The operating parameters include the 
acceptable voltage range of the data signals that the pins receive, the signal timing 
for writing and reading data, and the supported modes of operation (e.g., burst 
mode, page mode)> ConventiDna! physical layers include transistor-transistor logic 
(TTL) and RAMBUS. 

£303 The sen^ice layer includes the protocol by which a computing 

component transfers data. The protocol defines the format of the data and the 
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manner in which the component sends and receives the formatted data, 
Conveotlonai communication protocofs molude file-transfer protocol (FTP) and 
TCP/IP (expand). 

JSI] Consequently, because manufacturers and others typically design 

computing cornponents having industry-standard communication layers, one can 
typicatly design the interface of such a component and interconnect it to other 
computing components with reiatively little effort. This ailows one to devote most of 
his time to the designing the other portions of the computing machine, and to easily 
modify the machine by adding or removing components. 

|32] Designing a computing component that supports an industry-standard 

communication layer aSlows one to save design time by using an existing 
physical-iayer design from a design libra ry. This also insures that he/she can easily 
interface the component to off-the-sheif computing components. 

[33] And designing a computing machine using computing components that 

support a common industry-standard communication layer allows the designer to 
jnten:onnect the components with little time and effort. Because the components 
support a common interface layer, the designer can interconnect them via a system 
bus with little design effort. And because the supported interface layer is an Industry 
standard, one can easily modify the machine. For example, one can add different 
components and peripherals to the machine as the system design evolves, or can 
easily add/desfgn next-generation components as the technology evolves. 
Furthermore, because the components support a common industry-standard service 
layer, one can incorpDrate into the computing machine's software an existing 
software module that implements the corresponding protocol Therefore, one can 
interface the components with iittfe effort becayse the interface design is essentially 
atready in place, and thus can focus on designing the portions {e.g., software) of the 
machine that cause the machine to perform the desired function(s)* 

{343 But unfortunately, there are no known Industry-standard 

communication layers for components, such as PLICs, used to form hardwired 
pipelines such as the pipeiine 30 of FIG. 2. 
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[35] Consequentiy, to design a pipeiine having multSpSe PLICs, one typicaliy 

spends a significant amount of time and exerts a significant effort designing and 
debugging the communication layer between the PLlCs ''from scratch," Typically, 
such an ad hoc communiGatton iayer depends on the parameters of the data being 
transferred between the PLICs. Likewise, to design a pipeline that interfaces to a 
processor, one would have to spend a significant amount of time and exeit a 
significant effort in designing and debugging the communication layer between the 
pipeOne and the processor from scratch, 

tSB] Simiiarfy, to modify such a pipeiine by adding a PLIG to it one typically 

spends a significant amount of time and exerts a significant effort designing and 
debugging the communication layer between the added PLfC and the existing 
PLf Cs. Likewise, to modify a pipeline by adding a processor, or to modify a 
computing machine by adding a pipeline, one would have to spend a significant 
amount of time and exert a significant effort in designing and debugging the 
communication layer between the pipeline and processor. 

|37] Consequently, referring to FIGS, 1 and 2, because of the difficulties in 

interfacing multiple PLlCs and in interfacing a processor to a pipeline, one is often 
forced to make significant tradeoffs when designing a computing machine* For 
example, with a processor-based computing machine, one Is forced to trade number- 
crunching speed for complex decision-making ability and design/modification 
flexibility. Conversely* with a hardwired pipeline-based computing machine, one is 
forced to trade complex-decision-maktng ability and design/modification flexibiiity for 
number-cnjnching speed. Furthermore, because of the difficulties in interfacing 
multiple PLiCs, it is often impractical for one to design a pipeline-based machine 
having more than a few PLfCs. As a result, a practical pipallne^based machine often 
has fimited functbnayty. And because of the difficulties in interfacing a processor to 
a PLSC, it would be Impracticai to interface a processor to more than one PLIC, As a 
result, the benefits obtained by combining a processor and a pipeline wouid be 
minimaL 

[383 Therefore, a need has arisen for a new computer architecture that 

allows one to combine the decision-making ability of a processor-based machine 
with the number-crunching speed of a hardwired-pipellne-based machine. 

9 
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[391 an embodiment of the invention^ a peer-vector machine indudes a 

host processor and a hardwired plpeOne acceierator. The host processor executes a 
program, and, in response to the program, generates host data, and the pipeline 
acoeierator generates pjpelina data from the host data. 

[40] According to another embodiment of the invention, the pipeline 

acceierator generates the pipeline data, and the host processor generates the host 
data from the pipeline data. 

[41 J Because the peer-vector machine incfudes both a processor and a 

hardwired pipeiine accelerator, it can often process data more efficiently than a 
computing machine that includes on!y processors or only hardwired pipelines. For 
examp!e» one can design the peer vector machine so that flie host processor 
performs dedsion-making and non-mathematically intensive operations while the 
accelerator performs mathematically intensive operations. By shifting the 
mathematically intensive operations to the accelerator, the peer«vector machine 
often can, for a given clock frequency, process data at a speed that surpasses the 
speed at whidi a processor^only machine can process the data. 

Brief DEScmpTiON of the Drawings 

[42] FIG. 1 is a block diagram of a computing machine having a 

conventional mufti-processor architeciyre. 

[43] FIG* 2 is a block diagram of a conventional hardwired pipeline, 

[44] FIG. 3 Is schematic biock diagram of a oompiiting machine having a 

peer-vector architecture according to an embodiment of the invention. 

[45] FIG. 4 is a schematic block diagram of an electronic system that 

incorporates the peer»vector computing machine of FIG* 3 according to an 
embodiment of the invention. 

Detailed description 

[46] FIG. 3 is a schematic biocK diagram of a computing machine 40, which 

has a peer-vector architecfere according to an embodiment of the invention, in 
addition to a host processor 42, the peer-vector machine 40 includes a pipeiine 

10 



wo 20(M/<M2560 



CA 02503611 2005-04-25 



acceierator 44, which parforms at least a portion of the data processing, and which 
thus effectively repiaGes the bank of coprocessors 14 m the oomputing machine 10 
of FIG, 1 . Therefore, the host-processor 42 and the accelerator 44 are "peers" that 
can transfer data vectors back and forth. Because the accelerator 44 does not 
execute program instructions, it typically performs mathematicaiSy intensive 
operations on data significantJy faster than a bank of coprocessors can for a given 
dock frequency. Consequently, by combing the decision-making ability of the 
processor 42 and the number-crunchmg ability of the accelerator 44, the machine 40 
has the same abilities as, but can often process data faster than, a conventional 
computing machine such as the machine 10. Furthermore, as discussed in 
previously cited U.S. Patent App. Serial Nos, 10/684,053 entitled COMPUTING 
MACHiNE HAVING IMPROVED COMPUTING ARCHITECTURE AND RELATED 
SYSTEM AND METHOD and 10/683,929 entitled PiPEUNE ACCELERATOR FOR 
IMPROVED COMPUTING ARCHITECTURE AND RELATED SYSTEM AND 
METHOD, pn^vlding the accelerator 44 with the same communication layer as the 
host processor 42 facilitates the design and modification of the machine 40, 
particuiariy where the communications layer is an industry standard. And where the 
accelerator 44 includes muttipte oomponente (e.g., PLfOs), providing these 
components with this same communication !ayer facilitates the design and 
modification of th© acceierator* particuJarly where the communicetion layer is an 
industry standard, yoreover, the machine 40 may also provide other advantages as 
described below and in the previously cited patent applications, 

[47] in addition to the host processor 42 and the pipeline accelerator 44, the 

peer-vector computing machine 40 includes a processor memory 46, an interface 
memory 48, a bus 50, a firmware memory 52, optional raw-data input ports 54 and 
56, processed-data output ports 58 and 60, and an optiooai router 6t . 

[483 The host processor 42 includes a processing unit 62 and a message 

handler 64, and the processor memory 46 Includes a processing-unit memory 66 
end a handier memory 68, which respectively sen/e as both program and working 
memories for the processor unit and the message handier. The processor memory 
46 also includes an accelerator-configu ration registry 70 and a 
message-configuration registry 72, which store respective configuration data that 
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allow the host pfocessor 42 to configure the functioning of the acceierator 44 and the 
structure of the messages that the message handler 64 generates, 

|49| The pipeHne acceierator 44 is disposed on at least one PLIC (not 

Shown) and indudes hardwired pipelines 74i - 74n, which process respective data 
without exeouting program Instructions- The firmware memory 52 stores the 
configurBtfon firmware for the accelerator 44, If the accelerator 44 is disposed on 
multiple PLiCSj these PLICs and their respective firmware memories may be 
disposed on multiple circuit boards, he., daughter cards (not shown). The 
accelerator 44 and daughter cards are discussed further in previously cited U.S. 
Patent App> Serial Nos. 10/683,929 entitled PIPELINE ACCELERATOR FOR 
IMPROVED COMPUTING ARCHITECTURE AND RELATED SYSTEM AND 
METHOD and 10/683,932 entitled PIPELINE ACCELERATOR HAVING MULTIPLE 
PIPELINE UNITS AND RELATED COMPUTING MACHINE AND METHOD. 
Aiternatively, the acceierator 44 may be disposed on at least one ASIC, and thus 
may have intarna! interconnections that are unconfigurabie. In this aiternattve, the 
machine 40 may omit the firmware mamory 52. Furthermore, although the 
accelerator 44 is shown including multiple pipelines 74, it may include only a aSngfe 
pipeline, 

fSOl Still referring to FIG. 3* the operation of the peer-vector machine 40 is 

discussed below acconding to an embodiment of the invention* 

Configyrfrta the Peer^Vector ft/fachine 

[513 When the peer-vector machine 40 is first activated, the processing unit 

G2 configures the message handier 64 and the pipeiine aoceterator 44 (where the 
accelerator is configurable) so that the machine wil! execute the desired algorithm* 
Specifically, the processing unit 62 executes a host application program that is 
stored In the memory §6 and that causes the processing unit to configure the 
message handler 64 and the accelerator 44 as discussed below. 

[52] To configure the message handler 64, the processing unit 02 retrieves 

message-fDrmat information from the registry 72 and provides this format information 
to the message handler, which stems this information in the memory GO, When the 
machine 40 processes data as discussed below, the message handier 64 uses this 
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format information to generate and decipher data messages that have a desired 
format. In one embodimant the format information is written in Extensibie Markup 
Language (XML), although It can be written in another language or data format. 
Because the processing unit 62 configures the message handier 64 each time the 
peer-vector machine 40 is activated, one can modify the message format mereiy by 
modifying the fomiat information stored in the registry 72. Alternatively, an external 
message-oonfigu ration library (not shown) can store information for multiple 
message formats, and one can design and/or modify the host appJIcation so that the 
processmg unit 62 updates the registry 72 from selected parts of the library, and than 
downloads the desired format information from the updated registry to the message 
handler 64. The message format and the generating and deciphering of messages 
are further discussed below and in previousfy cited U.S. Patent App, Serial No. 
10/684,053 entitled COMPUTiHG MACHINE HAVING iMPROVED COMPUTING 
ARCHITECTURE AND RELATED SYSTEM AND METHOD. 

[Saj SimiiarSy, to configure the interconnection layout of the pipeiine 

accelerator 44, the processing unit 62 retrieves configu ration firmware from the 
registry 70 and downioads this firmware to the memory 52 via the message handler 
64 and the bus SO. The accelerator 44 then configures itself by downloading the 
firmware from the memory 52 into its interconnection-'Configyration registers (not 
shown). Because the processing unit 62 configures the accelerator 44 each time the 
peer-vector machma 40 is activated, one can modify the interconnection-layout — 
and thus the functioning — of the accelerator 44 merely by modifying the finnware 
stored in the registry 70. Altemativeiy, an external acGelerator-configyration library 
(not shown) can store firmware for multiple configurations of the accelerator 44, and 
one can design and/or modify the host application so that the processing unit 62 
updates the registry 70 from selected parts of the library, and then downloads the 
desired firmware from the updated registry to the memory 52. |Furthermore, the 
e)d:ernal library or the registry 70 may store finnware modules that define different 
portions and/or functions of the accelerator 44j Therefore, one can use these 
modules to facilitate the design and/or modification of the accelerator 44. in addition, 
the processing unit 62 may use these modules to modify the acceferator 44 while the 
machine 40 is processing data. The interconnectioo-'Gonfigy ration of the accelerator 
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44 and the firmware modutes are discussed further in previously cited U.S. Patent 
App. SeriaJ No, 10/684,057 entltfed PROGRAIVIMABLE CIRCUIT AND RELATED 
COMPUTING MACHINE AND METHOD. 

[54| The processing unit 62 may also "soft configure" the pipeline 

accelerator 44 while the peer-vector machine 40 is processing data. That is, the 
processing umt 62 may configure the functioning of the acceferator 44 without 
altering the accelerator's interconnection layout. Such soft configuration is 
discussed further below and in U.S, Patent App, Serial No, 10/683,929 entitled 
PtPELlNE ACCELERATOR FOR IMPROVED COMPUTING ARCHfTECTURE AND 
RELATED SYSTEi\/1 AND METHOD, 

Processing Data with the Peer-Vector Jfta^^ 

[55] In general, the peer-vector machine 40 eifectivaly divides the 

processing of raw data between the host processor 42an6 tiie pipeline accelerator 
44. For example, the host processor 42 may perform most or a!i of the 
decision-making operations related to the data, and the acceierator 44 may perform 
most or alJ of the mathematicaify intensive operations on the data. However, the 
machine 40 can divide the data processing in any desired manner. 

Operation of the Host Processor 

[56] In one embodiment, the host processor 42 receives the raw data from 

and provides the resulting processed to a remote device such as a sonar array 
(FIG. 5). 

1573 The host processor 42 first receives the raw data from the remote 

device via the input port B4 or the bus 50. The peer-vector machine 40 may include 
a FIFO (not shown) for buffering the received raw data* 

[58] Next, the processing unit 62 prepares the naw data for processing by 

the pipeline accelerator 44. For example, the unit 62 may determine, e.g., which of 
the raw data to send to the accelerator 44 or in which sequence to send the raw 
data- Or, the unit 62 may process the raw data to generate intermediate data for 
sending to the accelerator 44, The preparation of the raw data Is further discussed 
in previousiy cited U.S. PatBxxX App. Serial No. 10/684,053 entitied COMPUTING 
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MACHINE HAVING IMPROVED COMPUTING ARCHiTECTURE AND RELATED 
SYSTEM AND METHOD. 

[593 While preparing the raw data, the prooesamg unit 54 may also 

generate one or more "soft-configuration" commands to modify the functioning of the 
acceiarator 44. Uniike the firmware that configures the Interconnection layout of the 
acceferator 44 when the machine 40 is activated, a soft-configuration command 
controls the ftjnctioning of the accelerator without altering Its interconnection layout. 
For exampie, a soft-configuration command may control the size of the data strings 
(B.g,, 32 bits or 64 bits) that the accelerator 44 processes. Soft configuration of the 
acceierator 44 is discussed further in previousiy cited U.S. Patent App. Serial No. 
10/683,929 entitled PIPELINE ACCELERATOR FOR IMPROVED COMPUTING 
ARCHITECTURE AND RELATED SYSTEM AND METHOD, 

[603 The processing unit 62 then ioads the prepared data and/or soft- 

configu ration comniand(s) into a corresponding location of the interface memory 48, 
which BQls as a FIFO buffer between the unit 62 and the acceiarator 44* 

I6I3 Next, the message handler 64 retrieves the prepared data and/or 

software command{s) from the interi'ace memory 48 and generates message objects 
that indudethe data and/or command(s) and related information* Typicalfy, the 
accelerator 44 needs four identifiers that describe the data/com mand{s) and the 
related infomr^ation {collectively "infomrtation"): a) the Information's Intended 
destination {e.g., the pipeline 74i), b) the priority (e,g,, should the accelerator 
process this data before or after previousiy received data), c) the iength or the end of 
the message object, and d) the unique instance of the data (e.g., sensor slgnai 
number nine from an array of one thousand sensors). To facliitate this 
determS nation, the message handier 64 generates message objects that have a 
predetermined fonnat as discussed above, in addition to the prepared 
data/soft-configuration command(s), a message object typicaify includes a header 
that includes the four above-described identifiers and that may also include 
Identifiers that describe the type of information that object Indudes (e.g., data, 
command), and the algorithm by which the data is to be processed. This fatter 
identifier is useful where the destination pipeline 74 implements multiple algorithms. 
The handier 64 may retrieve the header information from the interface memory 48, or 
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may generate the header based on the location within the interface memory from 
which it retrieves the prepared data or command(s). By deciphering the message 
header, the router $1 and/or the accelerator 44 can direct the information within the 
message object to the desired destination, and cause that destination to process the 
information in a desired sequenoe. 

C62] Afternative embodiments for generating the message objects exist. For 

example, although each message object is described as includrng either data or a 
soft-configuration command, a single message object may inciude both data and one 
or more commands. Furthermore, aithough the message handier 64 is described as 
receiving the data and commands from the interface memory 48, it may receive the 
data and commands directly from the processing unit 54. 

[63] The generation of message ob|ects is discussed ftirther m prevrously 

cfted U.S, Patent App. Serial No. 10/684,053 entiied COMPUTING MACHINE 
HAVING tMPROVED COMPUTING ARCHITECTURE AND RELATED SYSTEM 
AND yETHOD, 

Pipeline Accelerator 

[643 The pipeSine acceierator 44 receives and deciphers the massage 

objects from the message handier 64 and effectiveiy directs the data and/or 
commands within the objects to the desired destinatlon(s). This technique Is 
particulariy useful where the number of afgorfthms implemented by the processing 
unit 62 and the pipeiines 74 are relativeiy $ma!!, and thus the rooter 01 can be 
omitted. Alternatively, where the number of algorithms implemented by the 
processing unit 62 or the number pipelines 74 is reiatively large, the router $1 
receives and deciphers the message objects from the massage handler 64 and 
effectively directs the data and/or commands within the objects to the desired 
destinatton(s) v^rfthin the accelerator 44. 

[65] in one embodiment where there are small numbers of processing-unit 

algorithms and pipefmes 74, each pipeline simultaneously receives a message 
object and anaiyzes the header to determine whether or not it is an intended 
recipient of the message. !f the message object is intended for a particular pipeline 
74, then that pipeline deciphers the message and processes the recovered 
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data/command{s). if, however, the message object is not intended for a partioilar 
plpeiine 74, then that pfpeMne ignores the message object. For example, suppose a 
message object includes data for processing by the pipelme 74i. Therefore, the 
pipefin© 74i analyzes the message header, determines that it is an intended 
destination for the data, recovers the data from the message, and processes the 
recovered data. Conversefy, each of the pipelines 74^ - 74„ analyzes the' message 
header, determines that it is not an intended destination for the data, and thus does 
not recover or process the data. If the data within the message object is intended for 
multiple pipelines 74, then the message handier 64 generates and sends a 
sequence of respective message objects that inciude the same data, one message 
for each destination pipeline. Alternativeiy, the message handler 64 may 
Simultaneously send the data to ail of the destination plpeiines 74 by sending a 
single message object having a header that identifies all of the destlnattan pipelines. 
Recovering data and soft-configuration commands from message objects is 
discussed further in previously cited U.S. Patent App. Serial Ho. 10/683,929 entitled 
PIPELINE ACCELERATOR FOR IMPROVED COMPUTING ARCHITECTURE AND 
RELATED SYSTEM AND METHOD. 

[66] in another embodiment where there are large numbers of 

processing-unit processes or pipelines 74, each pipeline receives message objects 
from the router 61. Although the router 6f should ideally send message objects only 
to the target pipeline 74, the target pipeiine still analyzes the header to detemnine 
whether or not it is an Intended recipient of the message. Such an analysis identifies 
potential message routing errors, Lb., exceptions. If the message object is intended 
for target pipeline 74, then that pipeline deciphers the message and processes the 
recovered data/command(s). if, however, the message object Is not intended ibr the 
target pipeline 74, then that pipeline Ignores the processing for that message object, 
and may also issue a new/ message to the host processor 42 indicating that a routing 
exception has occurred. Handling of routing exceptions is discussed in previously 
cited U.S. Patent App. Serial No. 10/;684.053 entitled COMPUTING MACHINE 
HAVING IMPROVED COMPUTING ARCHITECTURE AND RELATED SYSTEM 
AND METHOD, 
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[67] Next, the pipeline accaierator 44 processes the Incoming data and/or 

commands recovered from the message objects. 

[68| For data, the destination pipefine or pipelines 74 perform a respective 

operatton or operations on the data. As discussed in conjunction with FIG. 2, 
because the pipelines 74 do not execute program instructtons, they can often 
process the data at a rate that is substantiaHy the same as the frequency of the 
pipeline dock. 

|69| In a first embodiment, a single pipeline 74 generates resulting data by 

processing the incoming data. 

[70] In a second embodiment, muitipie pipelines 74 generate resulting data 

by serially processing the incoming data. For example, the pipeline 74 may generate 
first intermediate data by performing a first operation on the incoming data. Next, the 
pipeline 742 may generate second intermediate data by performing a second 
operation on the first intermediate data, and so on, until the final pipeline 74 m the 
chain generates the resuit data. 

|71] In a third embodmient, multiple pipeHnes 74 generate the resulting data 

by processing the incoming data in parailef. For example, the pipetine 74i may 
generate a first set of resulting data by performing a first operatton on a first set of 
the incoming data. At the same time, the pipeline 74a niay genemte a second set of 
resuiting data by performing a second operation on a second set of the incoming 
data, and so on. 

1723 Alternatively, the pipelines 74 may generate resuftfng data from the 

incoming data according to any combination of the above three embodiments. For 
example, the pipeline 74i may generate a first set of resuiting data by performing a 
first operation on a first set of the incoming data. At the same time, the pipeiines 742 
and 74^ may generate a second set of resuiting data by serialiy performing second 
and third operations on a second set of the incoming data. 

I7ZI in any of the above embodiments and aiternatives, a single pipeiine 74 

may perform multiple operations. For example, the pipeline 74^ may receive data, 
generate first intermediate data by performing a first operation on the received data» 
temporariiy store the first intermediated data, generate second intermediate data by 

IS 



wo 20(M/<M2560 



CA 02503611 2005-04-25 



performing a second operation on the first intermediate data, and so on, until it 
generates resutt data. There are a number of techniques for causing the pipeline 74i 
to switch from performing the first operation to performing the second operation, and 
so on. Such techniques are discussed in previousiy cited U.S. Patent App, Serial 
No. 10/683,929 entitled PIPELINE ACCELERATOR FOR IMPROVED COiVIPUTING 
ARCHITECTURE AND RELATED SYSTEM AND METHOD (Attorney Docket No. 
1934-13-3). 

[743 For a soft-configunation command, the accelerator 44 sets the bits in 

the corresponding soft-configuration register(s) (not shown) as indicated by the 
message header. As discussed above, setting these bits typicaily changes the 
liinctionjng of the accelerator 44 without changing its fnterconnection layout This is 
similar to setting bits in a control register of a processor for, e.g., setting an externa! 
pin as an input pin or an output pin or selecting an addressing mode. Furthermore, a 
soft-configuration command can partition a register or table (an an*ay of registers) for 
hoiding data. Another soft-configuration command or an operation performed by the 
accelerator 44 may load data mto the sofrconfigurad register or table. Soft 
configuration of the aocelorator 44 is discussed Hirther in previousiy cited U.S, 
Patent App. Seriai No. 10/683.929 entitled PIPELINE ACCELERATOR FOR 
IMPROVED COMPUTiNG ARCHITECTURE AND RELATED SYSTEM AND 
METHOD (Attorney Docket No. 1934-13-^3). 

[753 Next, the pipeline accelerator 44 provides the resulting data to the host 

processor 42 via the router 61 (or directly if the router is omitted) for further 
processing, 

[76] Alternatively, the acceterator 44 provides the resulting data to the 

remote destination (FIG- 5) either directly via the output port 60, or indirectly via the 
router 61 (if present), the bus 50, the host processor 42, and the output port 58. 
Consequently, in this altemative embodiment the resuiting data generated by the 
accelerator 44 is the final processed data. 

[77] When the acceierator 44 provides the resulting data to the host 

processor 42 — either for further processing or for pass through to file remote device 
{FIG. 5) ~ It sands this data in a message object that has the same format as the 
message objects generated by the message handler 64. Like the message obiects 
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generated by the message handler $4, the message objects generated by the 
accelerator 44 inciude headers that specify, e.g., the destination and the priority of 
the resulting data. For example, the header may instruct the message handier 64 to 
pass through the resulting data to the remote device via the port 5S, or may specify 
which portion of the program executed by the processing unit 62 Is to control the 
processing of the data. By using the same message format, the accelerator 44 has 
the same interface layer as the host processor 42. This facilitates designing and 
modifying the peer>vector machine 40, particularfy if the interface layer Is an Industry 
standard. 

I78| The structure and operation of the pipeline accelerator 44 and the 

pipelines 66 are discussed further In previously cited U.S. Patent App. Serial No. 
10/683.929 entitled PIPELINE ACCELERATOR FOR IMPROVED COMPUTING 
ARCHITECTURE AND RELATED SYSTEM AND METHOD (Attorney Docket No. 
1934-13-3). 

Receiving And Pf ocesslna From the Pipeline Acceiemtor With the Host 

Processor 

[79] When it receives a message object from the accelerator 44, the 

message handler 64 first deciphers the message header and directs the recovered 
date to the indicated destination. 

fSO] !f the header indicates that the data is to be passed to the remote 

device (FIG. 5) via the port 50, then the message handler 64 may provide the data 
directly to the port 58, or to a port FIFO buffer {not shown) formed in the Interface 
memory 48 or in another memory and then from the buffer to the port 58. Multiple 
ports 58 and multiple respective remote devices are also contemplated. 

[81] If, however, the header Indicates that the processing unit 62 is to 

further process the data, then the message handier 62 stores the data in a location 
of the Interface memory 4a that corresponds to the portion of the processing-unit 
program that is to control the processing of the data. More specifically, the same 
header now indirectly indicates which port!on{s) of the program executed by the 
processing unit 54 is(are) to control the processing of the data. Consequently, the 
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message handler $4 stores the data in the location (such as a FIFO) of the interface 
memory 48 corresponding to this program portion. 

[82] As discussed above, the interface memory 48 acts as a buffer between 

the acceierator 44 and the processing unit $2, and thus allows the transfer of data 
when the processing unit Is not synchronized to the accelerator. For example, this 
lack of synchronization may occur when the accelerator 44 processes data faster 
than the processing unit 62. By using the int^ce memory 48, the accelerator 44 is 
not siowed by the slower response of the processing unit €2. This also avoids the 
inefficiency penalties associated with the processing unit's indeterminate response 
time to handling interrupts. The indstemiinate handling by the processing unit 62 of 
the accelerator 44 output messages would unneces^rily complicate the 
accelerator's design by forcing the designer to provide either: a) storage and 
handling for^e badced up output messages, or b) idling controls throughout the 
pipeline to prevent the backed up messages from being overwritten. Therefore, the 
use of Interface memory 48, which acts as a buffer between the acceierator 44 and 
the processing unit 62, has several desirable consequences a) accelerators are 
easier to design, b) accelerators need less infrastructure and can hold larger PUC 
applications, c) accelerators can be streamlined to njn faster because output data is 
not "blocked" by a slower processor. 

IBZ) Then, for data that the message handler 64 has stored in the interface 

memory 48, the processing unit 62 retrieves the data from the Interface memory. 
The processing unit 62 may poll the Interface memory 48 to determine when new 
data has arnved in a particular location, or the message handler 64 may generate an 
Interrupt or other signal that notifies the processing unit of the data's anrlval. In one 
embodiment, before the processing unit 62 retrieves data, the message handler 64 
generates a message object that includes the data. More specfflcafly, one may 
design the program executed by the processing unit 62 to receive data in message 
objects. The message handier 64. therefore, could store a message object in the 
interface memory 46 instead of storing only the data. But a message object typically 
occupies significantly more memory space than does the data it contains. 
Consequentiy, to save memory, the message handler 64 deciphers a message 
object from the pipeline accelerator 44. stores the data in the memory 48, and then 
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effectiveiy regenerates the message object when the processing unit 62 is ready to 
reGeive the data> Then, the processing unit 62 deciphers the message object and 
processes the data under the control of the program portion identified in the 
message header, 

[843 Next, the processor unit 62 processes the retneved data under the 

controi of the destination portion of the program, generates processed data, and 
stores the processed data in a location of the interface memory 48 that corresponds 
to the intended destination of the processed data, 

[85] Then, the message handler 84 retrieves the processed data and 

provides it to the indicated destination. To retrieve the processed data, the message 
handier 64 may poll the memory 48 to determine when the data has arrived, or the 
processing unit 02 may notif/ the message handler of the data's arrivaf with an 
intenuipt or other signai. To provide the processed data to its intended destination, 
the message handier 64 may generate a message object that includes the data, and 
send the message object back to the accelerator 44 for further processing of the 
data- Or, the handler 66 may send the data to the port 58, or to another iocation of 
the memory 48 for fijrther pracessing by the processing unit 62. 

[86] The host processor's receiving and processing of data from the 

pipeline accelerator 44 is discussed further in previousiy cited U.S. Patent App, 
Seria! No. 10/684,053 entitled COMPUTING MACHINE HAViNG iMPROVED 
COMPUTING ARCHfTECTURE AND RELATED SYSTEM AND METHOD (Attorney 
Docket No. 1934^1 2-3). 

Aiternative Data Processing Techniques Using the Peer-Vector Machine 

[87] Btm referring to FIG- 3, there exist alternatives to the above-descrfbed 

embodiments in which the host processor 44 receives and processes data, and then 
sends the data to the pipe!ine acceferator 44 for further processing. 

£88] In one aJternative, the host processor 44 performs all of the processing 

on at least some of the data, and thus does not send this data to the pipeline 
accelerator 44 for further processing. 

[89] In another alternative, the pipeline accelerator 44 receives the raw data 

dlrectfy from the remote device {FIG. 5) via the port 56 and processes the raw data. 
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The aGcelerator 44 may then send the processed data directly back to the remote 
device via the port 60, or may sand the processed data to the host processor 42 for 
further processing. !n the fatter case, the accelerator 44 may encapsylata the data in 
message objects as discussed above. 

[90] in yet another aifematlve, tJie accelerator 44 may include, in additfon to 

the hardwired pipeiines 74, one or more instruction^executing processors, such as a 
Digitai Signal Processor (DSP), to complement the number-crunchfng abilities of the 
pipelines- 

Example impiementation of the Peer»Vector Machine 

[911 Stili referring to FIG. 3, in one embodiment, the pipeline bus 50 is a 

standard 133 MHz PC! bus, the pipelines 74 are included on one or more standard 
PMC cards, and the memory 52 is one or flash memories that are each located on a 
respective PMC card. 

Example Application of the Peer^-Vector Machlna 

[92] FIG. 4 is a block diagram of a sonar system 80 that Incorporates the 

peer-vector machme 40 of FIG, 3 according to an embodiment of the invention. In 
addition to the machine 40, the system 80 inciudes an array 82 of transducer 
elements fi4f - 84^ for receiving and transmitting sonar signals, digitai-to-analog 
converters (DACs) 86i - as«, anatog4o«dig}tal converters (ADCs) 88i - 88n. and a 
data interface 90. Because gene^ting and processing sonar signals are often 
mathematically Intensive functions, the machine 40 can often perform these 
functbos mora quickiy and efflcientiy than a conventional computing machine — 
such as the multl-pnocessor machine 10 {FIG. 1 ) ~ can for a given clock frequency 
as discussed above in conjunction with flG. 3* 

[931 During a transmit mode of operation, the array 82 transmits a sonar 

signal into a medium such as water (not shown). First, the peer»vector machine 40 
converts raw signef date received on a port 92 into n digital signals, one for each of 
the array elements 84. The magnitudes and phases of these signals dictate the 
transmission-beam pattern of the array 82. Next, the machine 40 provides these 
digitai signals to the interface 90, which provides these signals to the respective 
DACs 86 for conversion Into respeotive analog signals. For example, the Interface 
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90 may act as a buffer that seriaOy receives the digital signals from the machine 40, 
stores these signais untii it receives and buffers ail n of them, and then 
simultaneously provides these sequential signal samples to the respective DACs 86, 
Then, the transducer elements 84 convert these anatog signais into respective 
soundwaves, which interfere with one another to form the beams of a sonar signal 

|;94| During a receive mode of operation, the array 82 receives a sonar 

signal from the medium (not shov^n}. The received sonar signal is composed of the 
portion of the transmitted sonar signal that is reflected by remote objects and the 
sound energy emitted by the environment and the remote objects. First the 
transducer eiements 84 receive respective soundwaves that compose the sonar 
signal convert these soundwaves into n analog signals, and provide these anaiog 
signals to the ADCs 88 for conversion into n respective digital signals. Next, the 
interface 90 provides these digital signals to the pear-vector machine 40 for 
processing. For example, the interface 90 may act as a buffer that receives the 
digitai signats from the ADCs 88 in parafiei and then serially provides these signals 
to the machine 40. The processing that the machine 40 performs on the digital 
signals dictates the receive-beam pattern of the array S2, Additiona! processing 
steps such as filtering, band shifting, spectral transformation {e.g., the Fourier 
Transform), and convolution are applied to the digital signals. The machine 40 then 
provides the processed signal data via a port 94 to another apparatus such as a 
display device for viev^ng tocated objects. 

[95] Although discussed in conjunction with the sonar system SO, systems 

other than sonar systems may also incorporate the peer-vector machine 40. 

[96J The preceding discussion is presented to enable a person skilted in the 

art to make and use the invention. Various modifications to the embodiments will be 
readily apparent to those skilled In the art, and the generic principles herein may be 
applied to other embodiments and applications without departing from the spirit and 
scope of the present Invention* Thus, Ihe present invention is not intended to be 
limited to the embodiments shown, but is to be accorded the widest scope consistent 
with the principles and features disclosed herein. 
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WHAT IS CLAIMED fS: 

1 . A peer-vector machine, comprising: 

a host processor operable to execute a program, and, In response to the 
program, operable to generate fiVst host data; and 

a pipeiine acceierator coupled to the host processor and operable to receive 
the first host data and to generate first pipeline data from the first host data. 

2. The peer-vector machine of claim 1 wherein the host processor is 
further operable to: 

receive second data; and 

generate the first host data from the second data. 

3. The peer-vector machine of cfaim 1 wherein the host processor is 
further operable to: 

receive the first pipeline data from the pipeline accelerator; and 
process the first pipeline data. 

4. The peer-vector machine of cialm 1 wherein the host processor is 
further operable to: 

receive the first pipeline data from the pipeline acceierator; and 
generate the first host data from the first pipeline data. 

5. The peer*vector machine of claim 1 , further comprising: 

an interface memory coupled to the host processor and to the pipeline 
accelerator and having a first memory section; 
wherein the host processor is operable to, 

store the first host data in the first memory section, and 

provide the first host data from the first memory section to the pipeline 

acceierator* 

6. The peer-vector machine of ciaim 1 , further comprising: 

an interface memor>' coupied to the host processor and to the pipeline 
acceierator and having first and second memory sections; 
wherein the host processor is operable to, 

store the first host data in the first memory section, 
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provide the first host data from the first memory section to the pipeJine 
accelerator, 

receive the first pipeline data from the pipeline acceierator, 
store the first pjpetine data In the second memory section, 
retrieve the first pipeline data from the second memory section to the 
host processor, and 

process the first pipeline data. 

7. The peer-vector machine of claim 1 wherein the host processor is 
operable to configure the pipeline accelerator, 

8. The peer-vector machine of claim 1 wherein the pipeline accelerator 
comprises a programmable-iogic integrated circuit 

9. A peer-vector machine, comprising: 

a pipeline accelerator operable to generate first pipeline data; and 

a host processor coupled to the pipeline accelerator and operable to execute 

a program and, in response to tie program, operable to receive the first pipeline data 

and to generate first host data from the first pipeline data. 

10. The peei -vector machine of claim 9 wherein the pipeline accelerator is 
further operable to: 

racaive second data; and 

generate the first pipelioe data from the second data. 

1 1 . The peer-vector machine of claim 9 wherein the pipeline accelerator is 
further operable to: 

receive the first host data from the host processor; and 
process the first host data. 

1 2. The peer-vector machine of claim 9 wherein the pipef ine acceierator is 
further operabfe to: 

receive the first host data from the host processor; and 
generate the first pipeline data from the first host data, 

1 3. The peer-vector machine of claim 9, further comprising: 

an interface memory coupled to the pipeline accelerator and to the host 
pnDcessor and having a first memory section; and 
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wherefn the host processor is operable to, 

store the first pipeitfie data from the pipeiine aocelenator in the first 
memory section, and 

retrieve the first pipefine data from the first memory section. 

14. The peer-vector machine of claim 9, further comprising: 

an interface memory coupled to the pipeifne accelerator and to the host 
processor and having first and second memory sections; 
wherein the host processor is operable to, 

store the first pipeline data irom the pipeline acceierator in the first 
memory section, 

retrieve the first pipeline data from the first section, 
store the first host data in the second memorv^ section, and 
provide the first host data from the second memory section to the 
pipeline acceierator; and 

wherein the pipeline accelerator is operable to process the first host data 
received from the second memory section. 

16> The peer^vector machine of claim 9 wherein the host processor is 
operable to configure the pipeline accelerator, 

16, A system, comprising: 

a device operable to generate raw data; 

a host processor coupled to the device and operable to execute a program, 
and. in response to the program, operable to generate host data from the raw data; 
and 

a pipeline accelerator coupled to the host processor and operable to receive 
the host data and to generate pipeline data from the host data. 

17. A system, comprising: 

a device operable to generate raw data; 

a pipeline accelerator coupled to the device and operabfe to generate pipeline 
data from the raw data; and 
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a host procassor coupled to the pipeline accelerator and operabie to execute 
a program and, in response to the program, operabie to receive the ppeline data 
and to generate host data from the pipeline data, 

18. A method , comprising; 

generating first host data by executing a program with a host processor; and 
generating first plpeime data from the first host data with a pfpeiine 
acceierator 

19, The method of claim 18, further comprising: 
receiving raw data; 

wherern generating the first host data comprises generating the first host data 
from the raw data. 

20* The method of dalm 1 8 wherein generating the first host data 
comprises generating the first host data from the first pipeline data* 

21 , The method of claim 18, further comprising generating second host 
data from the first plpeime data by executing the program with the host processor. 

22. The method of ciaim 18, further comprising configyring the pipelfne 
accelerator by executing the program with the host processor, 

23. A method , comprising: 

generating first pipeline data with a pipeline accelerator; and 
generating first host data from the first pipeline data by executing a program 
with a host processor. 

24. The method of claim 23, further comprising: 
receiving raw data; 

wherein generafing the first pipeline data comprises generating the first 
pipeline data from the raw data, 

25, The method of claim 23 wherein generating the first pipeline tiBta 
comprises generating the first pipeline data from the first host data> 

26, The method of claim 23, further comprising generating second pipeiine 
data from the first host data with the pipeline accelerator. 
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27. The method of ciaim 23, further comprising cxjofiguriog the pipeline 
accelerator by executing the program with the host processor. 
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